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Abstract 

It is well known that any nonsingular M-matrix admits an LU fac- 
torization into M-matrices (with L and U lower and upper triangular 
respectively) and any singular M-matrix is permutation similar to an 
M-matrix which admits an LU factorization into M-matrices. Varga 
and Cai establish necessary and sufficient conditions for a singular 
M-matrix (without permutation) to allow an LU factorization with L 
nonsingular. We generalize these results in two directions. First, we 
find necessary and sufficient conditions for the existence of an LU fac- 
torization of a singular M-matrix where L and U are both permitted 
to be singular. Second, we establish the minimal block structure that 
a block LU factorization of a singular M-matrix can have when L and 
U are M-matrices. 



1 Introduction 

It was shown by Fiedler- Ptak, [Q], that any nonsingular M-matrix A admits 
an LU factorization, A = LU, where L is a nonsingular lower triangular 
M-matrix, and U is a nonsingular upper triangular M-matrix. Kuo, ||, 
proved that any (singular) irreducible M-matrix A admits an LU factoriza- 
tion, A = LU, where L is a nonsingular lower triangular M-matrix, and U 
is a upper triangular M-matrix, and she gave an example to show that not 
every singular M-matrix admits an LU factorization of this type. In |P3f . 
Varga and Cai establish necessary and sufficient conditions in terms of the 
directed graph Q(A) of A for a singular M-matrix to allow a LU factorization 
into M-matrices with L nonsingular. 



In this paper we consider the case where the conditions outlined in [13 
may not be satisfied. We generalize these results in two directions. First, 
we find necessary and sufficient conditions for the existence of an LU fac- 
torization of a singular M-matrix where both L and U are permitted to be 
singular. Second, we wish to factor an M-matrix A into A = LU, where L 
and U are M-matrices which are as close to lower and upper triangular as 
possible. Our goal is to minimize the number of nonzeros above the diag- 
onal of L and below the diagonal of U in a factorization A = LU and/or 
to optimize on their placement. Our approach to this problem is to min- 
imize the appropriate access relationships in the digraphs Q(L) and Q(U) 
of L and U respectively. In order to establish the minimal block structure 
that a block LU factorization of a singular M-matrix can have we need to 
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give careful definitions of what is meant by the block lower (upper) trian- 
gular self-partition of a matrix. These partitions are minimal in the set of 
partitions that lead to a block lower (upper) triangular matrix and they are 
solely determined by the zero/non-zero pattern of the matrix and thus do not 
depend on some assumed prior partitioning of the matrix. We use the term 
block factorization to indicate that we are interested in the block structure 
(without permutation) of the factors involved. 

We now describe our paper in more detail. Our definitions are contained 
in Section 2. 

In Section 3 we examine both LU and block LU factorizations of M- 



matrices where L and U are permitted to be singular. Thus, in Example 3.1 



we provide an M-matrix A which has an LU factorization into M-matrices 
only when L and U are both singular. In Theorem we identify the min- 
imum access relationships which must be present in G(L) and Q(U) and 
thus also identify the minimum sizes of the diagonal blocks of L and U in a 
block LU factorization. In Theorem |3]7] we show that these minimum block 
structures can be achieved. Returning to (elementwise) LU factorizations in 
Theorem |3.9| , we there characterize the M-matrices A which admit an LU 
factorization into (possibly singular) M-matrices. We give two strategies, 
one for finding a desirable block LU factorization, and the other for choosing 
a permutation matrix P so that PAP T has an LU factorization. 

In Section 4 we consider the case where L is a nonsingular M-matrix and 
U is an M-matrix. Using definitions and a result from McDonald 0, we 
actually examine a slightly larger class - factorizations of an M-matrix A 
for which L is nonsingular and inverse nonnegative, L~ l is class nonsingular 
for A, and U is an M-matrix. In Theorem |4.1| we show that for such a 
factorization, certain access relationships must be present in Q(U) and thus 
put a lower limit on the number of nonzeros below the diagonal of U. In 
Theorem L2 we show that we can attain these minimum access relationships 
using a factorization for which L is a lower triangular nonsingular M-matrix. 

In Section 5 we examine factorizations of A into LBU where L is a non- 
singular lower triangular M-matrix, U is a nonsingular upper triangular M- 
matrix, and B is a block diagonal M-matrix. Since L and U are nonsingular 
lower and upper triangular M-matrices, standard methods could be used to 
solve the parts of the system in which they are involved. Since B is generally 
a sparse matrix, it may be possible to use specialized techniques in this area 
to solve the part of the system involving B. 

We remark that analogous results hold for UL-factorizations and that 
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the techniques used in this paper can also be used to identify the minimum 
structures of U and L in this instance. 

Our results are of a graph theoretical nature, but we express the hope that 
our identification of possible block LU and LBU factorizations of singular M- 
matrices will extend applications and numerical implementations of block LU 
and LBU factorizations such as those discussed in || Chapter 12]. 

2 Definitions 

We begin with some standard definitions. Let n be a fixed positive integer. 
We write (n) = {1, . . . , n}. 

Throughout Section 2, X = [xy] will denote a matrix in R nn . 

We say X is: 
positive (X 3> 0) if Xij > 0, for all i,j G (n); 
semipositive (X > 0) if x^ > 0, for all i, j G (n) and X ^ 0; and 
nonnegative (X > 0) if x^ > 0, for all i,j G (n). 

We say X is a Z-matrix if X = al—P for some a G R with P nonnegative. 
If in addition, a is greater than or equal to the spectral radius of P, then we 
say X is an M-matrix. We denote the class ofnxn M-matrices by M.. 

For any J C (n), we let 

max(J) = max{j G J}, 

min(J) = min{j G J}, 

J + = {/ G (n) | Z > max(J)}, 

J- = {I E (n) \ I < min(J)}, 

J' = {le(n)\l# J}. 

| J | = number of elements in J. 

For any J,K<Z (n) , we write Xj^ to represent the submatrix of X whose 
rows are indexed by the elements of J and whose columns are indexed by 
the elements of K, where the elements of J and K are arranged in ascending 
order. 

We call the pair V = (V, E) a directed graph, where V is a finite set, and 
E <Z V xV . A path from j to k in T is a sequence of vertices j = r±, T2, rt — 
k, with (rj,r i+1 ) G E, for i = 1, — 1. A path for which the vertices are 



4 



pairwise distinct is called a simple path. The empty path is considered to be 
a simple path linking every vertex to itself. If there is a path from j to k, we 
say that j has access to k. If j has access to k and k has access to j, we say j 
and k communicate. The communication relation is an equivalence relation, 
and hence we may partition V into equivalence classes, which we will refer 
to as the classes of T. We define the closure T by T = (V, F), where V = (n) 
and F = {(i,j) \ i has access to j in T}. 

We define the (directed) graph of X by G(X) = (V, E), where V = (n) and 
E = | Xij 7^ 0}. It is well known that the classes of G(X) correspond 

to the irreducible components of X. For any class J of G(X) we say that J 
is a singular class of X if Xjj is singular, and we say that J is a nonsingular 
class of X if Xjj is nonsingular. 

We commonly view a matrix X as a block matrix 

Xn . . . X\ p 
V i •. - , 

X q i . . . X qp 

where Xij is m% x n,j with mi + rri2 + ■ ■ • + m q = n = n\ + n-i + . . . + n p . 
In this paper we will require that the diagonal blocks be square, viz. p = q 
and mi = rii, m 2 = n 2 , . . . , m q = n q . Rather than using mi, m.2, . . . , m q to 
describe our block structure, we will look at the sets = {m^i + 1, . . . m,}. 
More formally, we will say the sequence T = (vi,v 2 ,... ,v r ) is an (ordered) 
partition of (n), if U 4 r =1 t;j = (n), and Vi fl Vj = 0, for all i ^ j. We say T 
is an order preserving partition of (n) if T is a partition such that if % < j, 
then i e and j G ^ with ki < kj. We will say X is lower triangular 
with respect to the order preserving partition T = (vi, . . . , v r ) if X + = 0, 
for every i G (r). Clearly X may be block lower triangular with respect 
to several different partitions. We call \I> = (-01, ipz, . . . , ip p ) a refinement of 
an order preserving partition T, if ^ is also an order preserving partition 
of (n) and if for every % G (p) there exists j G (r) such that ipi C A 
refinement is said to be proper if \1/ 7^ T. The refinement relation on the set 
of order preserving partitions of (n) defines a lattice such that greatest lower 
bound of two partitions has as its elements intersections of the elements of 
the two partitions. The maximal element is ({1, 2, . . . , n}) , and the minimal 
element is ({1}, {2}, . . . , {n}). (For the corresponding result for unordered 
partitions see 0, Lemma 1, p. 192] and 0, Theorem 6, p. 7]). It is easy to 
see that the greatest lower bound, 9 = (0\, . . . , 9 q ), of the set of partitions 
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for which X is block lower triangular is also a partition for which X is block 
lower triangular, and we will refer to as the block lower triangular self- 
partition of X . Similarly, the greatest lower bound, $ = (0i, . . . , <f> p ), of the 
partitions T = (vi, V2, ■ ■ • , v r ), for which X v + = is referred to as the block 
upper triangular self-partition of X . Thus we say X is lower triangular if 
the block lower triangular self-partition of X is ({1}, {2} . . . {n}). Similarly, 
we say X is upper triangular if the block upper triangular self-partition of 
Xis({l},{2}..»). 

To illustrate the definitions above, let 
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where * denotes a nonzero entry Then viewed as a block lower triangular 
matrix 



X = 
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and has block lower triangular self-partition ({1,2,3}, {4,5,6,7}, {8}). 
However, viewed as a block upper triangular matrix 
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and has block upper triangular self-partition 



({1}, {2}, {3}, {4}, {5,6,7}, {8}). 

Let Ji, . . . , J r be subsets of (n). We say that an order preserving partition 
^ = (ipx, . . . ,ipt)i encompasses Ji, . . . , J r , if for each i G (r), there exists 
k G (t) such that T C ip k . It is easy to see that the greatest lower bound of 
the order preserving partitions which encompass Ji, . . . , J r , also encompasses 
Ji, . . . , J r and we will refer to this as the finest order preserving partition 
encompassing Ji, . . . , J r . 

Next we define subsets Tj and Tj associated with the matrix A. These 
subsets are defined in terms of the access relationships in Q{A) to and from 
the singular classes of A, and are convex in the sense that if j, k G T (or Tj), 
then / G T (Tj) for every j < I < k. 

Definition 2.1 Let A G R nn . Let Si, S2, ■ ■ ■ S m be the singular classes of A 
ordered so that max(Si) < max(S i+ i). For each i G (m), let \ii = max(Si), 
and 

Fi = {I > I there exists j > I such that j is accessed FROM Si in Q(A)}. 

Ti = {I > /ij I there exists j > I such that j has access TO Si in Q(A)}, 

These subsets turn out to be the key to understanding the block structure 
of a block LU factorization of A. 

Notice that the Fi for A correspond to the Tj for A T and vice versa. 

Remark 2.2 In |[L3|| , Varga and Cai show that an M-matrix admits an LU 
factorization into M-matrices with L nonsingular if and only if Tj = {/Zj} for 
every i G (m). 

Notice that if j > i and vertices in Sj are accessed from vertices in Si, 
then Fj C Tj, so if i is placed in J, then j should be also. Similarly if vertices 
in Sj have access to vertices in Si, then Tj C T and hence if i is placed in 
K , then j should be also. 



In Theorem |3.5| we show that for each i G (m), either Tj is encompassed 
in the block lower triangular self-partition of L or Tj is encompassed in the 
block upper triangular self-partition of U . This suggests that when factoring 
an M-matrix A, these T and Tj should be examined in order to determine 
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an optimal factorization of a given type. There are several possibilities for 
the types of factorizations one might want. In this paper we highlight four 



possibilities. In Strategy |3.10| we outline a strategy for choosing a partition 
(J, K) so as to minimize the sizes of the blocks in a block LU factorization 
of A. In Strategy we outline a strategy for choosing a permutation 
matrix P so that PAP T has an LU factorization. In Section 4 we look at the 
structure of U if L is required to be nonsingular (or vice versa). In Section 
5, we look at factoring A as LBU where L is a nonsingluar lower triangular 
M-matrix, U is a nonsingular upper trianglular M-matrix, and B is block 
diagonal. 



Example 2.3 Here we provide an example which illustrates the definitions 
introduced above. 
Let 

0-100 

-1 
0-100 

1 



A 



Then the block lower triangular self-partition of A is ({1,2,3,4}), and 
the block upper triangular self-partition is ({1}, {2, 3}, {4}). The singular 
classes of A are 

Si = {1}, S 2 = {2}, S 3 = {3}, 

and 

T 1 = {1}, T 2 = {2,3}, T 3 = {3}, 
F l = {1,2,3,4}, F 2 = {2,3,4}, F 3 = {3}. 
Notice that T 3 C T 2 and F 3 C F 2 C F x . 



In Section 4, we expand the results of [T3[ to include a larger set of LU 
factorizations, and we examine the block structure when no LU factorization 
exists. The class associated with an M-matrix A defined next includes all 
of the matrices U for which A = LU, with L, U 6 Ai and L nonsingular. 
Notice that this is actually a larger class since it allows for some M-matrices 
U G M. for which A = LU with L inverse nonnegative but not necessarily 
an M-matrix.. 
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For any A G R nn , we say a matrix X is class nonsingular for A if for 



every class K of A, X KK is nonsingular (see 
a class of X. We write 



Note that K need not be 



Ma = { X | X > and X is class nonsingular for A}. 

Definition 2.4 Let A be an M-matrix and define 

U{A) = { BA | B G A/a, BAe A-l}. 
= { AB | B g A/a, AB G M}. 



Block LU Factorizations with (Possibly) Sin- 
gular L and [/. 

3|, Varga and Cai consider LU factorizations of M-matrices where L is 

In Example |3.1| , the matrix A does not satisfy 
and hence does not have a LU factorization into 



In 

nonsingular (see Remark ^2 
the conditions stated in fT 
M-matrices with L is nonsingular. It does however, have an LU factorization 
when both L and U are allowed to be singular. 



Example 3.1 Let 



.4 









-1 

-1 



By 0, Theorem l,(see Remark [2.2|) 1, A does not admit a factorization 
A = LU with L a nonsingular lower triangular M-matrix and U an up- 
per triangular M-matrix. By applying the result to A T we see that A does 
not admit a factorization A = LU with L a lower triangular M-matrix and 
U a nonsingular upper triangular M-matrix. However, consider 
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L = 











, u = 
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Then A = LU, where L is a singular lower triangular M-matrix and U is a 
singular upper triangular M-matrix. 
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In this section we establish necessary and sufficient conditions for A to 
have an LU factorization into M-matrices, allowing both L and U to be 
singular. This result is stated as Corollary |3.9| . Enroute to establishing 
this result we also characterize the minimum block structure of block LU 
factorizations when no triangular factorization exists. These results appear 
as Theorem B.5I and Theorem IS - ?. 



In Strategy p.lOj , we outline a strategy one might take to minimize the 



block sizes in a block LU factorization of A. In Strategy 3.11, we suggest a 



permutation P such that PAP T admits an LU factorization. 

We begin with two lemmas and a corollary which we use to prove the 



main results in this section (Theorem |3.5| , Theorem 3/7 and Corollary 



First we show that if A = LU is a factorization of an M-matrix A into M- 
matrices and S is a singular class of L, then the vertices which are accessed 
by any vertex of S in G(A), are also accessed by the vertices of S in S(L). 

Lemma 3.2 Let A G A4 with factorization A = LU where L,U G jM. Let 
S be any singular class of L. Then for any p G S and any q G (n), if p has 
access to q in Q(A) then p has access to q in Q{L). 

Proof: 

Let q G (n). Suppose some p G S has access to q in Q{A) but not in Q{L). 
Then by choosing an appropriate section of a path from p to q in Q (A) , we 
can choose a path li — > l 2 — > . . . — > l g , in Q{A) so that 

heS, 

li has access to U in Q(L) and k ^ S for alH = 2, . . . , g — 1 

h does not have access to l g in Q(L), 

k 7^ lj, for all i ^ j. 

We will establish a contradiction by proving two claims. The proofs of 
Claim 1 and Claim 2 rely heavily on the sign patterns of A, L, and U. 

Claim 1 If r G S, t ^ S, are such that L r sUst < 0, then there exists s G S 
such that L st ^ 0. 

Proof of Claim 1: 



10 



Since L S s is an irreducible singular M-matrix and L ss Ust 7^ 0, by JT|, 
Theorem 4.16, p. 156] it must be a vector which contains both positive 
and negative elements. Hence there exists s G S such that L s sUst > 0. 
But then > A st = L st U u + P, where P > 0. Hence L st U u < 0, and 
in particular L st 7^ 0. This establishes Claim 1. 

Claim 2 For each j G (g — 1), 

(a) There exists r G 5 U {£2, • • • , Zj} 
with L H . +1 7^ 0, 

(b) If t S U {Z 2 , • • • , and t/; j+lf 7^ 0, then there exists 
r e SU {l 2 , with L rt ^ 0, 

Proof of Claim 2: 

We proceed by induction on j. 

Let j = 1 : 

(a) Since > A hh = L h i 2 U hh + L hS U S i 2 + P, where P > 0, 
either Li ll2 U[ 2 i 2 < and thus L ili2 7^ 0, or Li lS Usi 2 < and 
thus by Claim 1 there exists s G 5 such that L s / 2 7^ 0. 

(b) Suppose ?7; 2i 7^ 0, for some t ^ S U {I2}. By (a) there exists 
r G 5 with L r z 2 7^ 0, hence L r i 2 Ui 2t > 0. Thus > v4 rt = 
LrtUtt + L rS Ust + P, where P > 0. Hence either L rt U u < 
and thus L rt 7^ 0, or L r sUst < and by Claim 1, there exists 
s G S such that L st 7^ 0. 

Let k < g. Assume true for all j with 1 < j < k and show true for k. 

(a) Since > A hh+1 = L hlk+1 U lk+lh+1 + L lklk U lkh+1 + P, where 
P > 0, either L lkh+1 U h+llk+1 < and thus L hh+1 ^ 0, or 
Li k i k Ui k i k+1 < and so by the induction hypothesis (b) applied 
with j = k — 1 and t = h+i, there exists r G SU {Z2, ■ • ■ , h-i} 
such that L r i k+1 7^ 0. 

(b) Suppose [7 lfc+lt 7^ 0, for some t <£ S U {Z 2 , • • • ,h+i}- By (a) 
there exists r E S U {/ 2 , ■ ■ ■ , h} such that L r i k+1 7^ 0, hence 
L r i k+1 Ui k+lt > 0. Thus > A rt = L rt U tt + UrUrt + P, where 
P > 0. Hence either L r tU a < and thus L rt 7^ 0, or L rr U r t < 
and thus £/ ri < and so by the induction hypothesis applied 
with j = k — 1, there exists g G SU-j^, • • • ,h-i} with L ?t 7^ 0. 
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This establishes Claim 2. 



By Claim 2, there exists r G 5 U {Z2, • • • , ^-1} such that L r \ g 7^ 0, but 
then there exists t G 5 such that i has access to Z g in Q(L), and since 5 is 
a class of Q(L), it must be that li has access to l g in Q(L). Contradiction. 
Hence p must have access to q in Q(L). □ 



By applying Lemma 3.2 to A we get the following result. 



Corollary 3.3 Let A E M with factorization A = LU where L,U G M. 
Let S be any singular class of U . Then for any p G S and any q G (n), if p 
is accessed by q in G(A) then p is accessed by q in Q{U). 

Proof: 

Apply Lemma O to A T = U T L T . □ 



Next we show that every singular class of A has a corresponding singular 
class Q C S in either L or U. 



Lemma 3.4 Let A <E M with factorization A = LU where L,U G M.. Let 
S be any singular class of A. Then either L$s is singular or Uss is singular, 
and there exists Q C S such that Q is a singular class of either L or U . 



Proof: 



A ss = LssUss + Lss'Us's = L S sUss + P, where P > 0. 

Thus LssUss = Ass — P and hence is a Z-matrix. Suppose that Lss and 
Uss are both nonsingular. Then by [ffl, A^, p. 137], LssUss is a nonsingular 
M-matrix, and by |], J 2 7, p. 137] there exists x 3> such that LssUss^ 
0. But then A S sx = L S sUssx + Px ^> 0, which implies that A S s is a 
nonsingular M-matrix. A contradiction. Hence either Lss is singular or Uss 
is singular. Since any proper principal submatrix of an irreducible M-matrix 
is nonsingular, it must be the case that if Lss (or Uss) is singular, then the 
singular class Q of Lss (or Uss) is a singular class of L (or U). □ 

The next theorem shows that certain access relationships must be present 
either in L or U. In particular, for each i G (m), either Fi is encompassed in 
a block of L or Tj is encompassed in a block of [/. 
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Theorem 3.5 (Minimality) Let A G M. with factorization A = LU where 
L,U G A4. Let Si,Ti,Fi, and m be as in Definition \2. 1\ . Then there is a 
Qi Si such that Qi is a singular class of either L or U. If Qi is a singular 
class of L, then Fi is encompassed in the block lower triangular self-partition 
of L. If Qi is a singular class ofU, then Ti is encompassed in the block upper 
triangular self-partition ofU. 

Proof: 



That there exists such a Qi follows directly from Lemma O. If Qi is a 
singular class of L then by Lemma p.2| , any j which is accessed from Si (and 
hence Qi) in G(A) is also accessed from Qi in G(L), thus Fi is encompassed 
in the block lower triangular self-partition of L. Similarly, if Qi is a singular 
class of U, then Corollary implies that Tj is encompassed in the block 



upper triangular self-partition of U. □ 

It is natural for one to ask if, once an assignment of the singular classes 
between L and U has been chosen, such factorizations can be achieved. The 
following example shows that the singular classes of A cannot necessarily be 
divided up between L and U to suit ones choosing. 

Example 3.6 Let 

" -1 



.4 







The singular classes of A are Si = {1} and 5*2 = {2}. It is easy to verify that 
there is no factorization A = LU where S% is a singular class of L and S 2 is a 
singular class of U. Notice that F 2 C F\ and hence there is no combinatorial 
benefit to having S 2 not be a singular class of L once S\ has been chosen to 
be a singular class of L. 

In the next theorem we show that once a partition (J, K) of (m) has been 
chosen, a block factorization can be achieved with the block structure of L 
being a refinement of the partition encompassing Fi, i e J and the block 
structure of U being a refinement of the partition encompassing Ti, i G K. 

Theorem 3.7 (Existence) Let A E M.. Let Si,Ti,F i; and m be as in 
Definition Let (J,K) be a partition of (m). Let $ be the finest order 
preserving partition of (n) encompassing Fi, i 6 J and let T be the finest 
order preserving partition of (n) encompassing T i: % E K. Then there exists 
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a factorization A = LU such that L,U G M., the block lower triangular 
self-partition of L is a refinement of ^ , and the block upper triangular self- 
partition of U is a refinement ofT. 

Proof: 

We establish this result by outlining a recursive algorithm which gives us 
the desired factorization. 

If an 7^ then let 

N = {2,...,n} 

and set 

B = A NN A N1 Ai N . 

an 

Notice that B is an M-matrix and Q(B) C V where V is the subgraph 
of Q(A) induced by the vertices 2, . . . ,n. Moreover, if Q is a singular 
class of B (where B is indexed with indices corresponding to A) then 
Q C S where S is a singular class of A. Now apply the algorithm to B 
to obtain B = LU where L and U satisfy the theorem. Set 



«21 
an 

an 



... 



and U 



a n ai2 ■ ■ ■ ai n 



U 



Orel 
an 







Then A = LU satisfies the theorem. 



If an = 0, then \ — [ii. 
(i) If 1 G J then set 

V — {I | /ii has access to I in Q{A) }, 
W = (n)\V 

Notice that Ayw = 0, V C Fi, and max(V) = max(Fi). Choose 
a permutation matrix P such that 



A vv 




' A vv 


" 




' I 





A wv A ww 




Awv 


I 







Aww 
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where elements of V and W are listed in ascending order. Since 
Aww is a principal submatrix of A it is also an M-matrix and we 
can apply the algorithm to Aww to get Aww — LU where L and 
U have the desired structure based on the properties of Aww- Set 



L = P 



Aw 
A wv 




L 



P- 



U = P 



I 

u 



Then A = LU. We now argue that this factorization satisfies the 
theorem. Since applying the permutation similarity only reorders 
vertices, we see that Lyw = and Lww = L where L has the 
desired block structure based on the properties of Aww- We also 
have that Vc.Fi, thus the block lower triangular self-partition 
of L is a refinement of By again observing that applying the 
permutation similarity with P merely reorders vertices, we see 
that Uyy is a diagonal matrix, Uyw — 0, Uwv — 0, and Uww — U 
has the desired structure based on the properties of A W w- Thus 
the block upper triangular self-partition of U is a refinement of 
T. 

(ii) If 1 ^ J then 1 e K, and we can apply the algorithm to A T with 
J and K interchanged to get A T = LU. Set L = U T and U = 
L . Since transposing a matrix reverses the access relationships, 
the Fj for A correspond to the T; for A T and vice versa. By 
the argument presented in (i), the factorization A = LU has the 
desired properties. 

□ 



Example 3.8 Let 

"0-10 

0-10 

Let J = {1} and K = {2,3}. Then (J,K) is a partition of the singular 
classes of A, however since F2 C Fl, S% is automatically a singular class of 
L, thus T 2 , as the following factorization shows, need not be encompassed in 
the block structure of U. Notice that 
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provides an LU factorization which is a proper refinement of the partition 
identified by Theorem [3.7[ Here is a singular class of L rather than of U. 

The partitioning of the singular classes between L and U of this factor- 
ization is actually J = {1, 2}, K = {3}. Using this paritition of the singular 
classes, Theorem |3.5| and Theorem |3.7| guarantee that the L and the U listed 
above have the smallest possible blocks for this assignment of the singular 
classes between L and U. 



Next we state necessary and sufficient conditions for an M-matrix A to 



admit an LU factorization into M-matrices, thus extending the results in [13 
to the case where both L and U are allowed to be singular. 

Corollary 3.9 Let A G M.. Then the following are equivalent: 

(i) A admits a factorization A = LU, where L is a lower triangular M- 

matrix and U is a upper triangular M-matrix. 

(ii) Let Si,Ti,Fi, and m be as in Definition \2. J . Then for every i G (m), 

either Tj = {/!;} or Fi = {Hi}. 



Strategy 3.10 Using Theorem |3.5| and Theorem 3.7 one can strategically 



choose, for example, a partition which minimizes the sizes of the blocks in L 



and U. Let Si, Tj, Fi, and m be as in Definition |2.1| . For each i G (m), 
either Fi has to be encompassed in block of L or Tj has to be encompassed 
in a block of U. In each case, we choose the smallest block between the two, 
unless one of the sets (Tj or Fi) is a subset of an earlier choosen set in which 
case it has already been taken care of. 
Begin by setting V = (m). 

(i) For i = miniy), if < |Tj|, put i into J, otherwise put i G K. Remove 

i from V. At this time other elements from V may have automatically 
been taken care of (see Example |3.8p . Hence if % was placed in J, then 
for each j G V such that Fj C Fi, place j in J and remove j from V. 
If i was placed in K, then for each j G V such that Tj C Tj, place j in 
and remove j from V. 

(ii) Repeat (i) until V = 0. 
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(iii) Apply the algorithm provided in the proof of Theorem |3.7| with the 
partition (J, K). 



Strategy 3.11 Another strategy one might employ is to choose a permu- 
tation matrix P such that PAP T satisfies Corollary |3.7| , and hence has an 
LU factorization. There are several ways one might do this. For example, 
using /ij and m as in Definition |2.1| , one could choose a permutation matrix 
P which corresponds to the permutation which moves fix, . . . fi m to positions 
n — m + l,...n and reorders them (if necessary) so that fii is placed after fij 
whenever /ij has access to fij in G(A). All other indices should be shifted up 
by the appropriate amount. Then Fi = {/ij} so by Corollary |3~9l , a triangular 
LU factorization exists with J = (m) and K = 0. 

We conclude this section with two examples on which we illustrate the 
strategies suggested by the theorems in this section. 



Example 3.12 Let 
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Let Si, Hi, Ti, Fi be as in Definition 2.1. Then 



Sx = {1,2}, S 2 = {3,4}, S 3 = {6}, 

AH = 2, fi 2 = 4, /i 3 = 6, 

T 1 = {2}, T 2 = {4,5,6,7}, T 3 = {6,7}, 

Fx = {2,3,4,5}, F 2 = {4}, F 3 = {6}. 

Thus by [|13|, Theorem 1] (see Remark |2.2| ) A does not admit an LU factor- 
ization into M-matrices with L nonsingular. Similarly by |13, Theorem 1] 
applied to A T , A does not admit an LU factorization into M-matrices with 
U nonsingular. Using Strategy |3.10| we choose J = {2,3} and K = {1}. 
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The algorithm outlined in the proof of Theorem now gives us an LU 
factorization with 
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Let Si, Hi, Ti, Fi be as in Definition [2.1| . Then 

S-! = {2}, S 2 = {3, 5}, S 3 = {6}, S 4 = {7}, S 5 

\i\ = 2, jj 2 = 5, /i 3 = 6, /i 4 = 7, /i 5 = 8, 
= {2, 3, 4, 5, 6}, F 2 = {5, 6}, F 3 = {6}, F A = {7, 8}, F 5 = {8}, 
T x = {1, 2, 3, 4, 5, 6, 7, 8}, T 2 = {5, 6, 7, 8}, T 3 = {6, 7, 8}, T 4 = {7}, T 5 = {8}. 
Using strategy |3.10| one should set J = {1, 2, 3}, and K = {4, 5}. Using the 



algorithm outlined in Theorem p.7| we get 
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This factorization minimizes the sizes of the blocks in L and U. 



Using strategy |3.11| , we can choose a permutation which moves 2, 5, 6, 7, 8 
to the end of our list of indices and then reorders them as 6, 5, 2, 8, 7. Thus 
we take 
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which has an LU factorization with 
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4 Block LU Factorizations with Nonsingular 

L 

In this section we consider the case where an M-matrix A is factored into 
block triangular matrices with L nonsingular, such that L~ l is nonnegative 
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and class nonsingular for A, and U G J\4. Notice that if L is a nonsingular 
M-matrix, then L satisfies the given conditions, thus we are considering a 
larger set of LU factorizations than were considered in We would like L 



and U to be as close to lower and upper triangular respectively as possible. 
We begin by showing that certain access relationships must be present in 

Q{U). 

Theorem 4.1 (Minimality) Let A e M and U G U{A). Let Si, S 2 , . . . S m 

be the singular classes of A. Then for each i G (m) and j G (n), if j has 
access to Si in G(A), then j has access to some vertex q G Si in Q(U). 

Proof: Assume j has access to Si in Q(A). Since As^ is irreducible, j 
has access in Q(A) to every vertex of Si. Let Qi be any final class of Us^- 
For any q G Qi, we see that j has access to q in Q{A). Choose B G Ma such 
that BA = U. Applying |], Theorem 3.7] we see that j has access to q in 
G(U). ' □ 

Next we show that there is a U G U(A), for which the only nonzeros below 
the diagonal of U correspond to the required access relationships described 



in Theorem |4.1| . To optimize on the placement of these zeros, for each Si, we 
would like the vertex q in Theorem [TT] to be /ij. The desired U can be found 
by performing Gaussian elimination until a zero diagonal element is encoun- 
tered. When a zero diagonal element is encountered, that column should be 
skipped over, and the process continued. Thus we obtain a matrix U which 
is upper triangular except for spurs below the diagonal corresponding to the 
columns /ij. We thus obtain a U whose column envelope is small, where 
column envelope is defined similarly to the row envelope in [[|, p. 708]. 

Notice that using this algorithm the L which is produced is a nonsingular 
lower triangular M-matrix. 

Theorem 4.2 (Existence) Let A G M. Let Si, 5*2, . . . S m be the singular 
classes of A, and let = max(Si). Set 

X — {(jjfJ'i) I i ^ 3 > fa and j has access to ^ in G(A)}. 

Then A admits a factorization A = LU, where L G M. is lower triangular 
and nonsingular, and U G M. is such that for all j > k, Ujk = whenever 
(j) k) ^ X> an d u jj — if an d on ly if 3 = fa f or some i G (m). 
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Proof: Let A 6 be the matrix obtained from A by adding e to the (//j, fij) — 
th element in A, for each % e (m). Then for any £ > and any i e (m), 
is nonsingular by 0, Theorem 4.16(2) and Theorem 2.7]. Hence v4 £ is a non- 
singular M-matrix and thus all the diagonal elements of A 6 are positive. For 
each i {fii, . . . ,fi m }, and for each j > i, use multiplication by elementary 
matrices on the left to add appropriate multiples of row i to row j so as to 
reduce A 6 to a matrix for which the (j, i) — th element is 0. Since the matrix 
formed at each step of this process is also a nonsingular M-matrix, we will 
not encounter a nonzero diagonal element as we proceed in this fashion. 

Notice that since row k G (m), is not used as a pivot row, the elemen- 
tary matrices will be independent of e. By proceeding in this manner we can 
produce a matrix U £ such that = whenever % £ . . . , /i m } and j > i. 
Moreover, Q{U £ ) C G(A). 

The off diagonal elements of U e remain nonpositive, hence U £ is a Z- 
matrix. Since the leading principal minors of A 6 are positive, and adding 
a multiple of one row to another does not change the determinant, all the 
leading principal minors of U £ are positive. Hence U e is a nonsingular M- 
matrix. Since e only appears on the diagonal of U £ , U = lim e ^o U e is an 
M-matrix such that Ujk = whenever (j, k) x- It is easy to see that if we 
take L to be the inverse of the product of the elementary matrices used above 
(in the appropriate order) then L is a nonsingular lower triangular M-matrix 
and A = LU. Since all of the diagonal elements of A where used as pivots, 
except for the //j) — th, they must be nonzero both in A and in U. Since 
Ag.g. is singular, it must be that is singular. By the construction of 

U, UsiSi is an upper triangular matrix with nonzeros on the diagonal except 
possibly for « W(Uj , hence it must be that = 0. Thus U has the desired 
pattern. □ 

Example 4.3 Let 
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Then /i! = 2, ^ = 4, // 3 = 6 and X = {(3, 2), (4, 2), (5, 2), (5, 4), (7, 6), (8, 6)} 
Using our algorithm we get 
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The boxes indicate the positions of potential nonzero elements below the 



diagonal of U. Notice that even though (5, 2) G x, u 5j2 = 0. Theorem [O 
only asserts that the elements in x are potentially nonzero. 
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Remark 4.4 Theorem 471 gives a lower bound on the number of nonzeros 
which must occur below the diagonal of U. Let S\, . . . S m be the singular 
classes of A. Let /ij = max (Si), i G (m). Let 

Ri = { j G (n) | j > Hi and j has access to Hi in Q(A)}. 

Let 

R = U i=1 Ri. 

Then \R\ < the number of nonzeros below the diagonal of U. Moreover, 



Theorem [L2] shows that there is a factorization of A into a nonsingular lower 
triangular M-matrix L and a block upper triangular M-matrix U, for which 
the number of nonzeros below the diagonal of U < \R%\- The next 

example shows that if the Ri have nonempty pairwise intersection, then the 
number of nonzeros corresponding to this duplication is not identified by our 
theorems. 



Example 4.5 Consider 
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Both A and B have singular classes Si = {1}, S 2 = {2}, and in both 
Q(A) and G(B), vertices 2 and 3 access Si, and vertex 3 accesses S 2 . Using 



the notation of Remark %Q R x = {2,3}, R 2 = {3}, and R = {2,3}. By 
Theorem |4.1| , there must be at least 2 nonzero subdiagonal elements in U for 
any block LU factorization of A or B (where L and U satisfy the conditions 
of Theorem |4.1| ), and by Theorem |4.2|, there is an LU factorization of A and 
an LU factorization of B, each with at most 3 subdiagonal elements in the U 
and with the L a nonsingular lower triangular M-matrix. Notice that if we 
factor A = I A, then U = A has 2 nonzeros below the diagonal. However it 
can be shown that for any factorization of B = LU (where L and U satisfy 
the conditions of Theorem |4.1| ), U will have at least 3 nonzeros below the 
diagonal. 

Our next theorem characterizes the M-matrices A such that A = LU 
where L,U G M. with L nonsingular and lower triangular and U upper 
triangular. The equivalence of parts (ii) and (iii) of this theorem appear in 
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Theorem 4.6 Let A e M. Then the following are equivalent: 

(i) There exists U G 14(A) such that U is upper triangular. 

(ii) A admits a factorization A = LU, where L is a nonsingular lower tri- 

angular M-matrix and U is an upper triangular M-matrix. 

(iii) Let m,Ti, and /ij be as in Definition Then T{ = {fit}, Vz G (m). 
Proof: 



Follows from Theorem 4.1 and Theorem 4.2. □ 



5 Block LBU Factorizations 



Using Theorem |4.2| we can factor A = LBU into the product of a nonsin- 
gular lower triangular M-matrix L with a block diagonal M-matrix B and 
a nonsingular upper triangular M-matrix U. Since L and U are nonsingular 
lower and upper triangular M-matrices, standard methods can be used to 
solve the parts of the system in which they are involved. In general, B will 
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be a sparse matrix since its only nonzero off-diagonal entries occur in rows 
and columns corresponding to the ends of singular classes. In this specialised 
case it may be possible to use sparse matrix techniques to solve the part of 
the system involving B. 

Theorem 5.1 Let A e M. Let 

X = { UJ) \ J e (n}\{ fa \ i e (m)} } 

U{ (j,Hi) I i ^ { m )i 3 > Hi and j has access to fii in Q(A)} 

U{ (fajj) I i £ ( m ), j > Hi and j is accessed by /ij in Q(A)}. 

Then A admits a factorization A = LBU where L is a nonsingular lower 
triangular M-matrix, U is a nonsingular upper triangular M-matrix, and B 
is an M-matrix such that bjk = whenever (j, k) £ X- Moreover, if L and U 
are nonsingular M-matrices, this is the finest block structure that B can have 
(i.e it is impossible to subdivide the blocks of B and obtain a block diagonal 
matrix). 

Proof: 



Use Theorem [4.2| to factor A = LV where L is a nonsingular M-matrix 
and V is an M-matrix such that for all j > k, Vjk = whenever (j, k) 
{(J,fJ>i) | i G (m), j > Hi and j has access to \i{ in Q(A)}. Notice that the 
singular classes of V are just yUi,...,/i m , and G(V) C Q(A). Using the 
algorithm outlined in the proof of Theorem \j.2[ we can factor V T = XY 
where X is an nonsingular lower triangular M-matrix, and Y is an M-matrix 
such that for all j > k, = whenever (j,k) {(j, Hi) \ % € (m), j > 
fii and j has access to m in Q(A)}. Since rows fix, . . . , fi m are not used as 
pivot rows, and all other rows of V T have zeros to the right of the diagonal, 
Y will also satisfy the property that for all j > k, y^j = whenever (j, k) (jL 
{(j,Hi) I i ^ { m )i 3 > Hi an d j has access to fii in Q(A)}. Let B = Y T and 
U = X T . Then A = LBU is as claimed. By Theorem |4.1| , the block structure 
exhibited by B is the finest possible with L and U nonsingular M-matrices. 
□ 
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Example 5.2 Let 



.4 



1 










•1 














-1 



1 







1 

-1 









-1 



1 















-1 















0-1 




as in Example |3.13| Then 

\i\ = 2, jj 2 = 5, /i 3 = 6, /i 4 = 7, /i 5 = 8, 

and 

X = {(2, 3), (2, 4), (2, 5), (2, 6), (7, 2), (8, 2), (5, 6), (7, 5), (8, 5)(7, 6), (8, 6), (7, 8)}. 
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The boxes in B indicate the only possible positions for nonzero off diagonal 
entries. 
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